In order to solve the interference of similar background to object tracker in ground battlefield environment, an object tracking algorithm combining correlation filtering and improved color probability model was proposed. Firstly, based on the traditional color probability model, a color probability model emphasizing foreground was proposed by using the difference between foreground object histogram and background histogram. Then, a spatial penalty matrix was generated according to the correlation filter response confidence and maximum response position. This matrix was used to punish the likelihood probability of background pixel determined by the correlation filter, and the response map of the color probability model was obtained by using the method of integral image. Finally, the response maps obtained by the correlation filter and the color probability model were fused, and the maximum response position of the fusion response map was the central position of the object. The proposed algorithm was compared with 5 state-of-the-art algorithms such as Circulant Structure of tracking-by-detection filters with Kernels (CSK), Kernelized Correlation Filters (KCF), Discriminative Scale Space Tracking (DSST), Scale Adaptive Multiple Feature (SAMF) and Staple in tracking performance. The experimental results on OTB-100 standard dataset show that, the proposed algorithm has the overall accuracy improved by 3.06% to 55.98%, and the success rate improved by 2.24% to 54.97%； and under similar background interference, the proposed algorithm has the accuracy improved by 10.28% to 43.9%, and the success rate improved by 8.3% to 48.29%. The experimental results on 36 battlefield video sequences show that, the proposed algorithm has the overall accuracy improved by 2.2% to 45.98%, and the success rate improved by 3.01% to 58.27%. It can be seen that the proposed algorithm can better deal with the interference of similar background in the ground battlefield environment, and provide more accurate position information for the weapon platform.